INVERSE LITTLEWOOD-OFFORD PROBLEMS AND THE 
SINGULARITY OF RANDOM SYMMETRIC MATRICES 



HOI H. NGUYEN 



Abstract. Let M„ denote a random symmetric n by n matrix, whose upper diagonal 
entries are iid Bernoulli random variables (which take value —1 and 1 with probability 
1/2). Improving the earlier result by Costello, Tao and Vu [Ij, we show that M„ is non- 
singular with probability 1 — ©(n""^) for any positive constant C. The proof uses an 
inverse Littlewood-Offord result for quadratic forms, which is of interest of its own. 

o 
Q 

1. Introduction 

r— I 

Let An denote a random n by n matrix, whose entries are iid Bernoulli random variables 
^ which take values ±1 with probability 1/2. Let p„ be the probability that An is singular. 

(-H A classical result of Komlos [H [13] shows 

Pn = 0(n-^/2). (1) 

By considering the event that two rows or two columns of An are equal (up to a sign), it is 
clear that 

o 

2 p„>(l + o(l))n22i-. 

O 

It has been conjectured by many researchers that in fact this bound is best possible. 
j>! Conjecture 1.1. 

Pn = {\+o{l)r. 

In a breakthrough paper, Kahn, Komlos and Szemeredi [9] proved that 

Pn = o{mr). 

Another significant improvement is due to Tao and Vu [24| . who used inverse theory from 
additive combinatorics to show that pn = 0((3/4)"). The most recent record is due to 
Bourgain, Vu and Wood [2], who improved it to pn = 0((l/\/2)")- 
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Another popular model of random matrices is that of random symmetric matrices; this 
is one of the simplest models that has non-trivial correlations between the matrix entries. 
Let Mn denote a random symmetric n by n matrix, whose upper diagonal entries are iid 
Bernoulli random variables. 

Let Qn be the probability that M„ is singular. Despite its obvious similarity to pn, less 
is known concerning the bound for qn- A significant new difficulty is that the symmetry 
ensures that the determinant det(M„) is a quadratic function of each row, as opposed to 
det{An) which is a linear function of each row. 

As far as we can trace, the question to determine whether g„ tends to zero together with n 
was first posed by Weiss in the early nineties. This simple looking question had been open 
until a recent breakthrough paper by Costello, Tao and Vu [4J, who showed 

To prove this result, Costello, Tao and Vu introduced and studied a quadratic variant of 
the classical Erdos-Littlewood-Offord inequality concerning the concentration of random 
variables. Note that this classical inequality plays a key role in the work of Komlos to 
establish Q. 

Although the bound qn = n~^/'^+°(^) can be improved further by applying the more recent 
inequalities from j3j, it seems that the approach developed by Costello, Tao and Vu cannot 
give any bound better than n~^^'^^°^^\ 

In this paper we show that g„ decays faster than any polynomial in n. 
Theorem 1.2 (Main theorem). We have 

qn = 0{n-^) 

for any positive constant C , where the implied constant depends on C . 

One may hope to combine our approach and the "replacement technique" from [9j and [2j] 
to improve the bound further to exponential decay. However, we have not been able to do 
so. It is commonly believed that (see j26j) 

Conjecture 1.3. 

qn = {\ + 0{l)r. 

Notation. Here and later, asymptotic notations such as O, 0, and so for, are used under 
the assumption that n — )• oo. A notation such as Oc(.) emphasizes that the hidden constant 
in O depends on C. If a = ^{b), we write 6 ^ a or a 6. 

For a matrix A we use the notations rj(A) and Cj{A) to denote its z-th row and j-th column 
respectively; we use the notation A{ij) to denote its ij entry. 



INVERSE LITTLEWOOD-OFFORD PROBLEMS 



3 



2. The approach 

Let X = {xi, . . . , Xn) be the first row of Mn-, and aij, 2 < i, j < n, be the cofactors of Mn-i 
obtained by removing x and from M„. We have 



det(M„) = xf det(M„_i) + ^ aijXiXj. 

Roughly speaking, the main approach of [4J is to show that with high probability (with 
respect to M„_i) most of the Uij are nonzero. It then follows that, via the so called 



quadratic Littlewood-Offord inequality (Theorem 5.1), 



P^(det(M„) = 0) = n 



'l/8+o(l) 



In this paper we adapt the reversed approach, which consists of two main steps outlined 
below. 

(1) If P^(det(M„) = 0|M„_i) > n~'^^^\ then there is a strong additive structure among 
the cofactors aij. 

(2) With respect to M„_i, a strong additive structure among the aij occurs with neg- 
ligible probability. 

The first step, which is at the heart of our paper, concentrates on the study of inverse 
Littlewood-Offord problem for linear forms and quadratic forms. We will provide an almost 
complete answer to this problem throughout Section [3j |4j and [5j 

For the rest of this section we sketch the proof of Theorem |1.2[ 



We first show that it is enough to consider the case of Mn having rank n — 1, thanks to the 
following result. 

Lemma 2.1. For any 1 < k < n — 2, 

P(rank(M„) = k < n - 2) < 0.1 x P(rank(M2„_fe„i) = 2n - A; - 2). 

We deduce Lemma |2.1| from a useful observation by Odlyzko. 

Lemma 2.2 (Odlyzko's lemma, [17j). Let H be a linear subspace in R" of dimension at 
most k < n. Then it contains at most 2^ vectors from { — 1, 1}". 



Proof, (of Lemma 2.1 ) Because M„ has rank k, the subspace spanned by its rows intersects 
{— 1, 1}" in a set H of no more than 2^ vectors. Thus the probability that the subvector 
formed by the last n components of the first row of M„+i does not belong to H is at least 
1 - 2""+'=. Hence, 



P(rank(M„+i) = k + 2|rank(M„) = k) > I - 2' 



-n+k 
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In general, for 1 <t < n — k we have 

P(rank(M„+t) = k + 2t|rank(M„+t_i) = /c + 2(t - 1)) > 1 - 2-"+*+^-!. 

Because the rows (and columns) added to Mn+t-i each step (to create Mn+t) are indepen- 
dent, we have 

k) > 

--k + 2{t-l)) 

□ 

Next we show that in the case of M„ having rank n — 1, it suffices to assume that 
rank(M„_i) > n — 2, thanks to the following simple observation. 

Lemma 2.3. Assume that Mn has rank n — 1. Then there exists 1 < i < n such that the 
removal of the i-th row and the i-column of Mn results in a symmetric matrix Mn-i of rank 
at least n — 2. 



P(rank(M2n-fc-i) = 2n - k - 2|rank(M„) = 

n—k—l 

> Yl P(rank(M„+t) = k + 2t|rank(M„+t_i) = 
t=i 

> (1 - 2-"+^)(l - 2-"+^^+!) ... (1 - 2-1) > 0.1. 



Proof, (of Lemma 2.3) With out loss of generality, assume that the last n — 1 rows of M„ 
span a subspace of dimension n — 1. Then the matrix obtained from M„ by removing the 
first row and the first column has rank at least n — 2. □ 



-C\ 



To prove Theorem 1.2, it thus suffices to prove 
Theorem 2.4. 

P(det(M„) = 0,rank(M„_i) = n - 1) = 0(n" 
Theorem 2.5. 

P(det(M„) = 0,rank(M„_i) = n - 2) = ©(n"^). 



We will prove Theorem |2.4| by relying on a structural lemma stated below, which follows 
from our study of the inverse Littlewood-Offord problem for linear forms in Step 1. 

Lemma 2.6 (Structural theorem, degenerate case). Let e < 1 and C he positive constants. 
Assume that Mn-i has rank n — 2 and that 



Then there is a nonzero vector u = (ui, . . . , Un~i) with the following properties. 
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• All but rf elements of Ui belong to a symmetric proper generalized arithmetic pro- 
gression of rank Oc,e{^) and size n'-^'^-'^-'^) . 

• Ui G {p/q : p,q GZi, \p\, \q\ = n'-^c.^in')^ Jqj. q// j_ 

• u is orthogonal to n — Oc,e{n'') rows of Mn-i- 

We refer the reader to Section [3] for a definition of generalized arithmetic progression. 



Theorem 2.5 fohows from a similar structural lemma, which can be deduced from our study 



of the inverse Littlewood-Offord problem for quadratic forms in Step 1. 

Lemma 2.7 (Structural theorem, non-degenerate case). Let e < 1 and C be positive con- 
stants. Assume that has rank n — 1 and that 



C 



Then there exists a nonzero vector u = (ni, . . . ,'Un-i) with the following properties. 

• All but n*^ elements of Ui belong to a proper symmetric generalized arithmetic pro- 
gression of rank Oc^e(l) and size n'-^'^-^^-'^) . 

• Ui G {p/q : p,q ^7^, \p\, \q\ = n'^'^-^^"^)} for all i. 

• u is orthogonal to n — Oc,e{n'') rows of Mn-i. 



The rest of the paper is organized as follows. In Sections [3](5l we discuss the inverse 



Littlewood-Offord problem in details. As applications, we prove Lemma 2.6 and Lemma 



2.7| in Section |9] and Section [10] respectively. We conclude by proving Theorem |2.4| and 
Theorem 12.51 in Section [TTl 



3. The inverse Littlewood-Offord problem for linear forms 



Let Xi,i = 1, ... ,n be iid Bernoulli random variables, taking values ±1 with probability 2- 
Given a multiset j4 of n real number ai, . . . , a„, we define the random walk S with steps in 
A to be the random variable S := ^^Li (^iXi. The concentration probability is defined to be 



p{A) := supP(S' = a). 

a 



Motivated by their study of random polynomials, in the 1940s Littlewood and Offord |15j 
raised the question of bounding p{A). (We call this the forward Littlewood-Offord problem, 
in contrast with the inverse Littlewood-Offord problem discussed later.) They showed that 
if the tti are nonzero then p{A) = 0{n^^^'^ logn). Shortly after the Littlewood-Offord paper, 
Erdos [5] gave a beautiful combinatorial proof of the refinement 
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P{A) < ^ = O(n-V^). (2) 



The results of Littlewood-Offord and Erdos are classics in combinatorics and have generated 
an impressive wave of research, particularly from the early 1960s to the late 1980s. 

One direction of research was to generalize Erdos' result to other groups. For example, 
in 1966 and 1970 [12], Kleitman extended Erdos' result to complex numbers and normed 
vectors, respectively. Several results in this direction can be found in [II]. 

Another direction was motivated by the observation that ^ can be improved significantly 
by making additional assumptions about V. The first such result was discovered by Erdos 
and Moser [6], who showed that if ai are distinct, then p{A) = 0(n~^/^ log n). This bound 
was then sharpened to p{A) = 0(n~^/^) by Sarkozy and Szemeredi |20j . Another famous 
result regarding this result of Erdos and Moser is that of Stanley [21] , who shows that if ai 
are distinct then p{A) < p{Ao), where Aq := { — [n/2j, . . . , [n/2j}. 

In [8| (see also in [25]), Halasz proved very general theorems that imply the Sarkozy- 
Szemeredi theorem and many others. One of his results can be formulated as follows. 

Theorem 3.1. Let I be a fixed integer and Ri be the number of solutions of the equation 
flj^ H + ttj; = H + aj, . Then 



piA) = Oin-^'—2Ri) 



We remark that the Erdos-Littlewood-Offord inequality ^ and Theorem 3.1 of Halasz 



can be extended to the continuous setting. This type of concentration has been vastly 
investigated in the literature, we refer the reader to [71 |8l [HI [18] for further reading. We 
mention here an asymptotic result of Kanter |10j , which generalizes ^ and is closely related 
to our discussion 

Theorem 3.2. Let ^ be a symmetric convex measurable set in a vector space V , andai G V. 
Assume that there are Q{n) indices i such that Oi ^ Then we have 



a 



Let us now turn to the main goal of this section. 

Motivated by inverse theorems from additive combinatorics (see \25\ Chapter 5]) and a 
variant for random sums in [24', Theorem 5.2], Tao and Vu [23] brought a different view to 
the problem. Instead of trying to improve the bound further by imposing new assumptions 
as done in the forward problems, they tried to provide the complete picture by finding the 
underlying reason as to why the concentration probability is large (say, polynomial in n). 
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Note that the (multi)-set A has 2" subsums, and p{A) > means that at least ^ among 
these take the same value. This observation suggests that the set should have a very strong 
additive structure. To determine this structure, let us introduce an important concept in 
additive combinatorics, generalized arithmetic progressions (GAPs). 

A set Q is a GAP of rank r if it can be expressed as in the form 

Q = {90 + midi + • • • + rurdrl^i < "T-i < ^'i for all 1 < i < r} 
for some go, . . . , gr, Ni, . . . , Nr, N[, . . . , N^. 

It is convenient to think of Q as the image of an integer box B := {{mi, . . . , rur) G Z'"|Mj < 
mi < M-} under the linear map 

$ : (mi, . . . , mr) ^ go + H ^ "irffr- 

The numbers gi are the generators of P, the numbers N-, Ni are the dimensions of P, and 
Yol{Q) := \B\ is the volume of B. We say that Q is proper if this map is one to one, or 
equivalently if \Q\ = Vol(Q). For non-proper GAPs, we of course have \Q\ < Vol(Q). If 
—Ni = N- for all i > 1 and go = 0, we say that Q is symmetric. 

We next consider an example of A where p{A) is large. For a positive integer I we denote 
the set {ai + + ai\ai £ A} hy I A. 

Example 3.3 (Structure implies large concentration probability). Let Q be a proper sym- 
metric GAP of rank r and volume N. Let ai,...,o„ he (not necessarily distinct) ele- 
ments of P. The random variable S = ^"=i diXi takes values in the GAP nP. Because 
\nP\ < Yol{nB) = n^'N, the pigeonhole principle implies that piV) > r2(— ^). In fact, 
by using the second moment method, one can improve the bound to ^( ^^/2jy )- U we set 
N = vP~'^l'^ for some constant C > r/2, then 



The example above shows that, if the elements of A belong to a symmetric proper GAP 
with a small rank and small cardinality, then p{V) is large. A few years ago, Tao and Vu 
\12\ [23] proved several versions showing that this is essentially the only reason. We present 
here an optimal version due to Vu and the current author. 

Theorem 3.4 (Optimal inverse Littlewood-Offord theorem for linear forms). [iBii Theorem 
2.5] Let e < 1 and C he positive constants. Assume that 



p{A) > n 



-c 



Then, for any n'^ < n' < n, there exists a proper symmetric GAP Q of rank r = Oc,e{^) 
that contains all but at most n' elements of A (counting multiplicity), where 



\Q\ = OcApi^r'ri' 5). 
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Our method can be extended to more general distributions. We just cite one below for our 
later applications. 

Let < < 1 be a positive parameter. Let tj^ be a random variable such that 77^ = 1 or 
— 1 with probability /x/2, and rj^ = with probability 1 — /i. 



Theorem 3.5. The conclusion of Theorem \3.4\ also holds if the Xi are iid copies of rj^ . 

Remark 3.6. In their work to obtain the bound p„ = 0((3/4)"'), Tao and Vu studied a 
similar inverse problem. 

Let 0</i<l/4bea parameter, and let e < 1 be a positive constant. 
Define 



p^^\A) := supP(Va,7?f = a). 
aeR .^^ 

It can be shown that p{A) < p^^\A). In [24j . Tao and Vu characterized those A where p{A) 
is comparable to Pn{A), 



p{A)>ep^^\A). 

4. The inverse Littlewood-Offord problem for bilinear forms 



Let Xi, Uj be iid Bernoulli random variables, let A — (uij) be an n x n matrix of real entries. 
We define the bilinear concentration probability of A by 



PbiA) := supP(V]aijXi?/j = a). 

More generally , if Xi,yj are iid copies of 77^, then the weighted bilinear concentration 
probability of A is defined by 



Pb i"^) = supPCy2aijXiyj = a). 

As an application of the Littlewood-Offord- Erdos inequality Q, it has been shown in [3] 
(also in [3j with a weaker bound) that 

Theorem 4.1 (Bilinear Littlewood-Offord inequality). Suppose that there are Q{n) indices 
i such that for each i there are Q{n) indices j such that aij 7^ 0. Then 



Pb{A) = 0(n-V2). 
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The bound 0{n ^/'^) is sharp, as the bihnear form Ylij ^iVj shows. 

The bihnear Littlewood-Offord inequahty for the continuous setting was also studied in the 



literature. For instance, as an application of Kanter's inequality (Theorem 3.2), it follows 
from a result of Rosihski and Samorodnitsky p!9] that 

Theorem 4.2. Let ^ be a symmetric convex measurable set in a vector space V , and ai G V . 
Assume that there are Q{n) indices i such that for each i there are Q{n) indices j such that 
aij ^ <I>. Then we have 



sup P(\^ aijXiVj e a + ^) = 0(n"^/^^^ 

a&V 



Rosihski and Samorodnitsky also studied concentration inequalities for more general mul- 
tilinear forms. We refer the reader to pi)J for further reading. 

Motivated by the inverse Littlewood-Offord results for linear forms, our goal is to find the 
reason as to why pb{A) is large. 

Question 4.3. Is it true that if Pb{A) is large then there must be a "structural" relation 
among the entries of A? 

To answer this question, we first consider a few examples of A. 

Example 4.4 (Additive structure implies large concentration probability). Let Q be a 

proper symmetric GAP of rank r = 0(1) and of size n'-^^^^ Assume that aij G Q, for all 
Qij. Then for any Xi,yj G {±1}, 

aijXiyj £ n^Q. 
Thus, by the pigeon-hole principle, we have 



Pb{A)>n-^'\Q\-' 



n 



-Oil) 



Our next example shows that if the "separable", then Pb{A) is also large. 

Example 4.5 (Algebraic structure implies large concentration probability). Assume that 

(lij = kibj + ^j'^i) 

where bj,h[ are arbitrary real numbers and ki,lj G Z, \ki\, \lj\ = n^^^\ such that 



P^i^kiXi = 0) 
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and 



n 



-0(1) 



Then we have 



^x,y{Yl ^vXiVi = 0) = p X] ^i^i ^jy^ + ^'i^^ ^^yj = ^ 



Remark 4.6. In the above example, the assumption that fcj, L- are integers seems unnecessary. 



3.4 



However, because Vxi^^kiXi = 0) = n^'^(^) and ^yi^jljUj = 0) = n^^^^\ Theorem 
imphes that most of the ki and Ij belong to a GAP of bounded size. Thus, without loss of 
generality, are bounded integers. 

Our last example shows that a combination of additive structure and algebraic structure 
also implies high bilinear concentration probability. 

Example 4.7 (Structure implies large concentration probability). Assume that aij = a'^^ + 
a'-j, where a[j G Q, a proper symmetric GAP of rank 0(1) and size n'^^^\ and 



where bij, . . . , brj, b'^^, . . . , b'^^ are arbitrary and ka, . . . ,kir,lij, . . . , Uj are integers bounded 
by nP'^^\ and r = 0(1) such that 



Y*x I ^ ^ kiiXi — 0, . . . , ^ ^ kirXi — j 

\ i i J 



and 



hjVj = 0, . . . , ^ IrjVj = 



Then we have 



Yl "'j^^^j = Yl j^^^^i + Y Y ^yy^ + • • • + 

+ Y ^'i^^' Y ^y^i + ■ ■ ■ + ^ir^' Y ^^oVr 
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Thus, 



It then follows, by the pegion-hole principle, that Ph{A) = n~^^^\ 



The above examples demonstrate that if the aij can be decomposed into additive and 
algebraic structural parts, then ph{A) is large. Our inverse result asserts that these are 
essentially the only ones that have large bilinear concentration probability. 

Theorem 4.8 (Inverse Littlewood-OfFord theorem for bilinear forms). Let e < 1,C be 
positive constants. Assume that 



Pb{A) > n 



-c 



Then there exist index sets Io,Jo, both of size Oc,e(l), and index sets I, J, both of size 
n — Oc{n'^), with Ir\Io = 9,Jr\Jo = ^, and there exist integers k,l, kiiQ,ljjg,io € Iq, jo S 
Jo^i ^ I , j ^ J , all of size bounded by n'^'^'^^"^\ such that the following hold for all i G /; 

• for any j E J, 

~ kl k / ' 

• all but Oc{n^) entries a'- belong to a proper symmetric GAP Qi depending on i, 
which has rank Oc^e(l) and size n^'~^'^^^\ 



Although Theorem 4.8 is enough for our later application, it does not yet reflect the examples 
given, namely the additive structures Qi corresponding to each row can be totally different. 
In the next theorem we show that these GAPs can be unified into a structure similar to a 
GAP. 

Theorem 4.9 (Inverse Littlewood-Offord theorem for bilinear forms, common structure). 

Let e < 1, C be positive constants. Assume that 



Then there exist index sets Io,Jo, both of .size Oc,e{^), and index sets I, J, both of size 
n — Oc{n'^), with Ir\Io = 9,Jr\Jo = 9, and there exist integers k,l, kiiQ,ljj^.,iQ G Iq, jo € 
Jo,i £ I , j £ J , all of size bounded by 71*^"^''^^^ such that for all i £ L the following hold: 

• for any j £ J, 
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~ Id 



k I 

all but Ocirf) entries a[ - belong to a set Q (independent of i) of the form 



Oc,.(i) 

Q = {J2 (Ph/ih) ■ gh;ph,qh ^ 'Z',\ph\,\qh\ 



n 



Oc,.(i) 



}• 



h=l 



Our proof of Theorem 4.8 and 4.9 can be extended (rather automatically) to other Bernoulli 
distributions. 



Theorem 



Theore m 4. 10. Let < < 1 be a constant. Then the conclusions of Theorem 4-^ CLf^'t- 
4-9 also hold if we assume that p^^\A) > n"*^. 



Remark 4.11. The inverse Littlewood-Offord problem for bilinear forms was also studied in 
[3], but only for the case pbiA) > n-^+°'^^\ 



5. The inverse Littlewood-Offord problem for quadratic forms 

Let Xi be iid Bernoulli random variables, let A = (uij) be an n x n symmetric matrix of 
real entries. We define the quadratic concentration probability of A by 



Pq{A) := sup P(7 ^ ajjXjXj = a). 

More general, if Xi are iid copies of r]>^, then the weighted quadratic concentration probability 
of A is defined by 



pII'\A) := supPC^OijXiXj = a). 



It was shown in [3]11J, as an application of Theorem 4.1 that 



Theorem 5.1 (Quadratic Littlewood-Offord inequality). Suppose that there are B(n) in- 
dices i such that for each i there are @{n) indices j such that Oij ^ 0. Then 



Pq 



(^) <n-i/2+°W. 



The bound almost best possible, as demonstrated by the quadratic form 

J2ij XiXj. 



A more general version of Theorem 5.1 also appeared in the mentioned paper of Rosihski 
and Samorodnitsky. 
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Theorem 5.2. [19l Theorem 3.1] Let ^ be a symmetric convex measurable set in a vector 
space V, and ai G V. Assume that there are Q{n) indices i such that for each i there are 
@{n) indices j such that Oij ^ ^. Then we have 



supF(S^ aijXiXj £ a + ^) = 0{n ^/^^). 

Motivated by the inverse Littlewood-Offord resuhs for hnear forms and biUnear forms, we 
would hke to characterize those A which have large quadratic concentration probability. 

We first consider a few examples of A when Pq{A) is large, based on the examples given in 
the previous sections. 

Example 5.3 (Additive structure implies large concentration probability). Let Q be a 

proper symmetric GAP of rank r = 0(1) and of size rfi^^\ Assume that Uij € Q, then for 
any Xi G {±1} 



id 

Thus, by the pigeon-hole principle, 

/9,(.4)>n-2nQri = n-««. 



Similar to Example 4.5, our next example shows that if the ajj are separable, then Pq{A) is 
large. 

Example 5.4 (Algebraic structure implies large concentration probability). Assume that 



where ki G Z, \ki\ = n'^^^^ and such that Px(X^j kiXi = 0) = n~^^^\ 
Then we have 



P(y^ aijXiXj = 0) = P(^ hxi ^ bjXj = 0) 



In our last example, we show that a combination of both structures also implies high 
quadratic concentration probability. 

Example 5.5 (Structure implies large concentration probability). Assume that atj = a'.-^ + 
a'lj, where a[j €z Q, a proper symmetric GAP of rank 0(1) and size n'^^^\ and 
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where bu, . . . ,bri are arbitrary and kn, . . . , kir are integers bounded by n^^^\ and r = 0(1) 
such that 



Px ^ kilXi — 0, . . . , ^ ^ kirXi — 0^ 



n 



-o(i) 



Then we have 



^ aijX^Xj = ^ a'ijXiXj + kaXi)iY^ bljXj) + • • ■ + ^ira^i)(^^ ^rj 



Thus, 



FxC^^o-ijXiXj e n^Q) = n 
It then follows, by the pigeon-hole principle, that Pq{A) = n~^^^\ 



Next we state our main result which asserts that the examples above are essentially the 
only ones that have high quadratic concentration probability. 

Theorem 5.6 (Inverse Littlewood-OfFord theorem for quadratic forms). Let e < 1,C be 
positive constants. Assume that 



Pg{A)>n-^. 

Then there exist index sets Iq and I of size Oc,e(l) and n — Oc{n'') respectively, and IDIq = 
0, and there exist integers k,kiig E Z,io £ lo^i £ I; M bounded by n^C'^^^\ such that the 
following hold for all i € // 

• for any j e /, 

ffljj — CLj^j / k k ^ ^ kiif^Oi^j / k k ^ ^ kji^aiQi / k , 

• all but Oc{n^) entries a'- belong to a proper symmetric GAP Qi depending on i, 
which has rank Oc,e(l) and size n'-^'^-^^^\ 



Similar to Theorem 4.9, we show that the structures Qi from Theorem 5.6 can be unified 
into a structure similar to a GAP. 
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Theorem 5.7 (Inverse Littlewood-Offord theorem for quadratic forms, common structure). 
Let e < 1, C he positive constants. Assume that 

Then there exist index sets Jq, / of size Oc,e{^) o-nd n — Ocin'^) respectively, with ICiIq = 0, 
and there exist integers k,kiiQ,io £ Io,i G I, all of size bounded by n'-^'^-''^^^ such that for all 
i & I the following hold: 

• for any j £ I, 

ciij = ci^j/k k ^ ^ kiiQai^j/k k ^ ^ kjiQCLiQi/ k ; 

• all but Oc{n^) entries a[j belong to a set Q (independent of i) of the form 

OcW 

Q = (Ph/qh) • 9h;Ph,qh e z, \ph\,\qh\ = n*^'^-'^^^}. 

h=l 

Remark 5.8. The conclusions of Theorem 15.61 and Theorem 15.71 also hold if we assume that 

p'fHA)>n-^. 

We invite the reader to prove this result using the approach presented in Section [8j 

Remark 5.9. The inverse Littlewood-Offord problem for quadratic forms was also studied 
in but only in the case Pq{A) > n~^/^^°^^\ 

6. A RANK REDUCTION ARGUMENT AND THE FULL RANK ASSUMPTION 

This section, which can be read independently of the rest of this paper, provides a technical 
lemma we will need for later sections. Informally, it says that if we can find a proper 
symmetric GAP that contains a given set (in the spirit of Sections [Sj [4] and [5]) , then we can 
assume this containment is non-degenerate. More details follow. 

Assume that P = {migi + • • • + mrgr \ — Mi < rui < Mj} is a proper symmetric GAP, which 
contains a set C/ = {ui, . . . .Un}- 

We consider P together with the map $ : P — )• R** which maps migi + • • • + m^^r to 
(mi, . . . , nir). Because P is proper, this map is bijective. 

We know that P contains U, but we do not know yet that U is non-degenerate in P in the 
sense that the set ^{U) has full rank in R^. In the later case, we say U spans P. 

Theorem 6.1. Assume that U is a subset of a proper symmetric GAP P of size r, then 
there exists a proper symmetric GAP Q that contains U such that the following hold. 
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• rank(Q) < r and \Q\ < Oril)\P\; 

• U spans Q, that is, 4>{U) has full rank in Ri'ank(Q)_ 

To prove Theorem |6.1[ we will rely on the following lemma. 

Lemma 6.2 (Progressions lie inside proper progressions). [ 25i. Chapter 3.] There is an 
absolute constant C such that the following holds. Let P be a GAP of rank r in R. Then 
there is a symmetric proper GAP Q of rank at most r containng P and 

\Q\<r^''\P\. 



Proof, (of Theorem 6.1) We shall mainly follow [JH Section 8]. 



Suppose that ^{U) does not have full rank, then it is contained in a hyperplane of R*". In 
other words, there exist integers ai, . . . ,ar whose common divisor is one and aimi + • • • + 
Ornir = for all (mi, . . . ,mr) G ^{U)- 

Without loss of generality, we assume that Or / 0. We select w so that gr = OrW, and 
consider P' be the GAP generated by := gi — OiW for 1 < i < r — 1. The new symmetric 
GAP P' will continue to contain U, because we have 



mig'i H h mr-ig'r-i = migi H h rrirgr - w{aimi H h Urgr) 

= migi-\ h rurgr 

for all (mi, . . . ,mr) G ^{U). 

Also, note that the volume of P' is 2'^~^Mi . . . Mr-i, which is less than the volume of P. 



We next use Lemma 6.2 to guarantee that P' is symmetric and proper without increasing 
the rank. 

Iterate the process if needed. Because we obtain a new proper symmetric GAP whose rank 
strictly decreases each step, the process must terminate after at most r steps. 

□ 



7. PROOF OF Theorem 4.8 , Theorem 4.9, and Theorem 4.10 



We begin by applying Theorem 3.5 



Lemma 7.1. Let e < 1, Q < < 1, and C be positive constants. Assume that p'^\A) > 
n"*^. Then the following holds with probability at least jn~'-^ with respect toy = (yi, . . . , y^). 

There exist a proper symmetric GAP Qy of rank Oc,e,^l{^) cind size Oc,e,fi{^/Ph^^) and a set 
Ly of n — n*^ indices such that for each i £ ly we have 
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Proof, (of Lemma 7.1) For short we write 



i,j i=l 

We say that a vector y = {yi, . . . , yn) is good if 

n 

Y,{Y^Xi{vi,y)=a)>p[^'^/A. 

i=l 



We call y bad otherwise. 

First, we estimate the probability p of a randomly chosen vector y = (yi, . . . , y„) being bad 
by an averaging method. 



PyP,Y.^ri,y) = p\; 



1=1 



{l-pi'^)/{l-pi''>/A)>p. 
Thus, the probability of a randomly chosen vector being good is at least 

1 > (34^V4)/(1 - 4^V4) > 3/,['^V4. 
Next, we consider a good vector y € G. By definition, we have 



PxExi(ri,y) = a)>p['^V4. 
1=1 



A direct application of Theorem 3.5 to the sequence (ri,y), i = 1, . . . ,n yields the desired 



result. □ 



By Theorem 6.1 we may assume that the (rj,y) span Qy. From now on we fix such a Qy 
for each y. 

Let G be the collection of good vectors. Thus, 
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Py{y eG)> 3pl^>/A. (4) 

Next, for each y & G, we choose from ly s indices iyj^, - ■ ■ ,iy^ such that {riy.^y) span Qy, 
where s is the rank of Qy. We note that s = Oc,e,ij,{^) for all s. 

Consider the tuples {iy^, . . . , iyj for all y E G. Because there are Yls Oc,e,tJ,{n^) = rfi'^'^'i^^^^ 
possibilities these tuples can take, there exists a tuple, say (1, . . . ,r) (by rearranging the 
rows of A if needed, we may assume so), such that {iy^, ■ ■ ■ i^ys) — {^■>-- ■ if) fo^ ^■ll V ^ G' , 
a subset of G satisfying 



Pj/(y e G') > Y'y{y G G)/n^c;.e,M(i) = p]i;\A) /n^c,.A'^) _ (5) 
For each 1 < i < r, we express (rj, y) in terms of the generators of Qy for each y e G', 



{ri,y) = Cii{y)gi{y) ^ \- Cir{y)gr{y), 

where cuiy) , . . . Cir{y) are integers bounded by Tnpc,<L,fiW ^ ^nd gi{y) are the generators of 

Qy 

We will show that there are many y that correspond to the same coefHcients Cij. 

Consider the collection of the coefficient-tuples ^(cii(y), . . . , ci,.(y)); . . . ; (cri(y), . . . Crr{y))^ 
for all y & G' . Because the number of possibilities these tuples can take is at most 



There exists a coefficient-tuple, say ^(cn, . . . , cir), ■ ■ ■ , (c^i, . . . c^r)^ , such that 

((cii(y), . . . , cir{y));. . . ; (0^1(2/), • • ■ £Vr-(y))) = ((cn, . . . , ci^), • . . , (c^i, • • ■ cv^)) 
for all y & G" , a subset of G' satisfying 



Py{y e G") > Py{y e G')/n^^'^^^^^^ > p^(^)/n^c;.e,^(i). (g) 

In summary, there exist r tuples (cn, . . . , ci^), • • . , (c^i, . . . c^r), whose components are in- 
tegers bounded by ■npc,e,ti{i) ^ sMch that the following hold for all y G G" . 

• {n,y) = Ciigiiy) H 1- Cjrgriy), for i = 1, . . . ,r. 

• The vectors (cn, . . . , cir), . . . , (c^i, . . . Crr) span Z^^^^^^y\ 
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Next, because \Iy\ > n — rf for each y G G", there is a set / of size n — 2>rf such that 
/ n {1, . . . , r} = and for each i £ I we have 

PyiiGly,yeG")>PyiyeG")/2. (7) 
Indeed, let /' be the set of i satisfying Q. Then, as 

E E i=EEi^(---^)iG"i' 

i y&G",i€ly y&G" i€ly 

we have ^ie/' |G'"|/2 > (n - n^)|G"|. Hence, 

+ (n- |/'|)|G"|/2 > {n-n')\G"\, 

from which we deduce that |/'| > n — 2rf. To obtain / we just remove the elements of 
{1, . . . , r} from I' . 

Now fix an arbitrary row r of index from /. We concentrate on those y G G" where the 
index of r belongs to ly. 

Because (r, y) G Qy^ we can write 

(r,2/) = ci{y)gi{y) + . ..Cr{y)gr{y) 
where Cj(y) are integers bounded by n'-^c,i,^W^ 

For short, WG denote the vector (qi, • • • ; Cij- ) by Vj for each i. We will also denote the vector 
(ci(y),...Cr(y)) by Vr,^;. 

Because Qi is spanned by (ri, y), . . . , (r,., y), we have k = det(vi, . . . v^) ^ 0, and that 

k{r,y) + det(vr,y, V2, . . . , Vr)(ri,y) H h det(vr,y, vi, . . . ,Vr-i){rr,y) = 0. 

Next, because each coefficient of the identity above is bounded by n'^^''^'''^^^ there exists a 
subset G" of G" such that all y G G'^ correspond to the same identity, and 

P,(y G > {Py{y G G'0/2)/(nOo,.M(i))- = p[>''^ /n^^.W . (8) 
In other words, there exist integers ki, . . . , kr, all bounded by n'-^c.^.i^W ^ such that 

k{r,y) + A;i(ri,y) H h A;,.(r,.,y) = 
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for all y G G'/. 

Note that k is independent of r and y. We thus conclude below. 

Lemma 7.2 (The rows are mutually orthogonal to many {—1,0, 1} vectors). Let i be any 

index of I. Then there are numbers kn, . . . ,kir G Z, all bounded by n^c^^.iiW ^ such that 



Py{k{r„y) + Y,k^J{rj,y)=0)=pi^^/n''<^'''^('\ 



Putting Lemma |7.1[ Lemma 7.2, and Theorem 3.5 together, we obtain the following result. 

Theorem 7.3 (Refined row relation). Let 0<e<l, 0</i<l, and C be positive 
constants. Assume that /^[^^(A) > n^*^. Then there exist a set Lq of size Oc,e,fj.{^), « set 
I of size n — 3n^ with I D Lq = and there exists a nonzero integer k of size rpc,t,ti{^) 
such that the following holds for all i G /.■ there exists a proper symmetric GAP Qi of rank 
Oc,t,fi{^) and size n'^'^-^-i^^^\ an index set Ji of size n — n'^ , and integers kiig,io £ Lq, all 
bounded by n'-^c.^.t^.W ^ such that the following holds for all j G Jj 



^ ^ kuQOigj + kttij G Qi. 

Because the role of rows and columns of A can be swapped, we obtain a similar conclusion 
for the columns of A. 

Theorem 7.4 (Refined column relation). Let 0<e<l,0</U<l, and C be positive 
constants. Assume that p^^\a) > n~'-' . Then there exist a set Jq of size Oc,e,n{^), o, set 
J of size n — Sn*^ with J n Jo = 0, and there exists a nonzero integer I of size n'^c,€,iJ.W 
such that the following holds for all j G J: there exists a proper symmetric GAP Pj of rank 
Oc,e,fi{^) o,nd size n^'^'^-f^^^^ an index set Lj of size n — n'^ , and integers ljQj,jo G Jo, all 
bounded by rfc,e,ti{^)^ such that the following holds for all i G Lj 

joe Jo 

Next we introduce the following two matrices. 

Definition 7.5 (Row matrix). L is an n by n matrix, whose i-th row, where i G /, is 
defined by 



r,.(L)(j) 



K ifj = ^; (9) 

0, otherwise. 



The other entries of L are zero, except the diagonal terms which are set to be 1. 
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Definition 7.6 (Column matrix), i? is an n by n matrix, whose j-th column, where j G J, 
is defined by 



cj{R){i) 



lij, if i G Jo; 

I, if « = j; 
0, otherwise. 



(10) 



The other entries of R are zero, except the diagonal terms which are set to be 1. 

Remark 7.7. For each i £ I, the non-singular matrix L acts on the left of A by rescaling 
ri{A) by a factor of k, modulo Ylioeio ^Ho^io- For each j G J, the non-singular matrix R 
acts on the right of A by rescaling Cj{A) by a factor of I, modulo YljoeJo hoi^io- 



Define 



A' := LAR. 

First, consider the matrix AR. By definition, {AR)ij £ Pj for all i £ Ij, where j £ J. By 
adding a constant number of generators to Pj we may assume that {AR)ij £ Pj, where 
i £ Jo- 
Next, consider the matrix A' = LAR. Suppose that j £ J, then we have 



{LAR)ij = k{AR)ij + kii^{AR)i^j. 

ioS/o 

Because k^ku^^ = n^c,t,^W^ n tj^ug follows that {LAR)ij £ n'^c.^.^.W . p- whenever i £ 
Ij n /. To avoid notational complication, we keep the same notation Pj for this new proper 
symmetric GAP (which is still of rank Oc,e,^{^) and size rf'c,t,^{'^) ^ with possibly worse 
constants). 

We have just shown that for each j £ J there exists a proper symmetric GAP Pj of rank 
Oc,e,/x(l) and size ■nPc,t,ti{'^) such that all but n*^ coordinates of the j-th column of A' belong 
to>;-. 

Similarly, by viewing LAR as {LA)R, we infer that for each i £ I, there exists a proper 
symmetric GAP Qi of rank Oc,e,fii^) and size n^c,c,^W such that all but n'' coordinates of 
the i-th row of A' belong to Qi. 

Putting everything together, we obtain the following result. 

Theorem 7.8 (Matrix relation). Let 0<e<l, 0<;U<1, and C be positive constants. 
Assume that p^^\A) > . Then there exist index sets Iq,Jq, both of .size Oc,e{^), and 
index sets /, J , both of size n — 3n^, with I D Iq = 0, J H Jo = 0, such that the following 
holds. There exist two matrices L,R defined by ^ and (10) respectively such that the 
matrix A' = LAR possess the following properties. 
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For each i €z I, there exist a subset C rj(^') of size n — rf and a proper symmetric 
GAP Qi of rank Oc,e,fi{^) and size n^c,e,tJ.W gy^^Ji iJiq^i r'- C Qi. 

For each j G J, there exist a subset c'- C Cj[A') of size n—n^ and a proper symmetric 
GAP Pj of rank Oc,e,/i(l) and size nPc,i,^{'^) g^ch that c'- C Pj. 



We now deduce Theorem 4.8 Assume that i G I and j G J. We then have 



i^j —klaij + ^Mo^«ojo^ioi 

'06/0 j6Jo 

-|- / ^ ^ kn^ai^j + k ^ ^ ZjQj 



This identity imphes 



E 



kl 



«oe/o iosJo 



(11) 



To complete the proof of Theorem 4.8 we just need to add Oi^j^ to the set of the generators 
of Qi. 



To finish the proof of Theorem 4.9, it is enough to show that the proper symmetric GAPs 
from Theorem [LSI can be unified. 



Lemma 7.9. Assume that for each i ^ I, there exist a subset r'- C of size n — n'' and a 
proper symmetric GAP Qi of rank Oc,e,^{^) and size rpc,^,^i{'^) such that C Qi, and for 
each j G J , there exist a subset c'j C Cj of size n — n'' and a proper symmetric GAP Pj 
of rank Oc,e,^(l) and size n^c,c.iJ.W such that c'- C Pj. Then there exist a bounded number 
of generators gi, ...,gs, where s = Oc,eA^), such that the set {Yl=i{Phl qh)9h, \Ph\, \qh\ = 
j^Oc,£,m(i)| contains all but at most en entries of all but at most en rows of A. 



It is clear that Theorem 4.9 follows from Lemma 7.9 It thus remains to verify this lemma. 



Proof, (of Lemma 7.9 ) Throughout the proof, if not specified, all the rows and columns will 



have index in / and J respectively. We assume that all the proper GAPs has rank at most 
r = Oc,e{l). 

By throwing away at most en/2 rows, we may assume that for each row rj all but at most 
n'^/2e indices j satisfy ri{j) G c'j C Pj. Let be the collection of these rj(j) for each i. 



Set 
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5 = e/2r. 

Consider an arbitrary r'-. It's components are combinations of the generators of Qi. Thus 
we may view these elements of r'- as vectors over z^^^HQi) (gee Section |6|. We say that the 
elements of r'- are independent if their defining vectors are independent. 

Next we will choose a subset r" of r'- with the following properties. 

(1) |r'/| >(l-e)n. 

(2) Let Hi be the subspace generated by the defining vectors of the components of r". 
Then any hyperplane of Hi contains no more than (1 — S)\r'- \ such defining vectors. 

We show that there must exist such r". 

Assume that r[ does not have the above property. By definition of r^, this means that (2) is 
not satisfied. We next pass to consider the set of at least (1 — (5)|r'j| components that belong 
to a proper subspace. Assume that this set does not have the above properties either, we 
then keep iterating the process. Because the dimensions of the subspaces strictly decrease 
after each step, the process must terminate after at most r steps. By definition, the subset 
r" obtained at the time of termination has the desired properties. 

Also, 

|r-'| > |r-| - r6\r',\ = (1 - e/2)(n - n72e) > (1 - e)n. 

Now we will group some generators from the Pj 's to create a new set S. 

We start with the first column Cj^ and put the generators of Pj-^ into S. Assume that we 
already gathered the generators of P,-^, . . . , Pj^. after k steps. 

To choose a Pj for the next step, we consider the defining vectors of r'/(ji), . . .r'^jk) for 
each i. Let dim(r^'(ji), . . . r'-{jk)) denote the dimension of the subspace generated by these 
vectors. 

By the definition of r'/, if r'/(ji), . . .r'^jk) do not generate Hi (in which case we say that 
r'- is not complete), then there are at least (5(1 — e)n > 6n/2 ways to choose Pj so that 
dim(r'/(ji), . . . r^'(jfc), r'/(j)) = dim(r^'(ji), . . . r^'(jfc)) + 1. In this case we say that there is 
an increase in dimension in r". 

Hence after some k steps, if there are an rows that are not complete, then, by the pigeon- 
hole principle, there is a choice for Pj which results in an increase in dimension in at least 
a5n/2 rows r". 

Because the total of the dimensions is bounded by rn, there must be at least (1 — e)n rows 
that are complete after at most 2r/{ed) = 2r^e^ steps. Let S be the collection of all the 
generators of Pj considered until this step. The size s of S" is then at most 2r^/e^. 
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Consider a row r'- that is complete. Assume that its elements are generated by r"(ji), . . . , r'/(jV), 
where r^'(jfc) S Pj,^, a GAP whose generators belong S. Let a be any element of r'/, and let 
a be its defining vector in Qi, we then have 

a = det (a, r-'(j2), • • • , r'iir)) det (r'/(ji), . . . , r-'(>))~^ • r'/(ii) + • • • 
+ det (r-'(ji), . . . , r-'(>-i), a) det (r-'(ji), . . . , r-'(>))"^ • r/(ir)- 



Thus a can be written in the form Ylh=iiPh I Qh) ■ dh, where \ph\, \qh\ = n'^^'-'^^^ 



8. PROOF OF Theorem 15.61 and Theorem 15.71 



□ 



In this section we will use the results from Section [7] to prove Theorem 5.6 and Theorem 

Let U he a random subset of {!,... ,n}, where P(i G C/) = 1/2 for each i. Let Au be a 
submatrix of A defined by 



Au{ij) 



ttij if either i ^ U,j ^ U oi i ^ U, j ^ U , 
otherwise. 



We first apply the following lemma. 

Lemma 8.1 (Concentration for bilinear forms controls concentration for quadratic forms). 

Pq{Af < Py^^{Y^Au{ij)viWj = 0), 



where Vi,Wj are iid copies of rf-l"^ . 



Proof, (of Lemma 8.1) We first write 



Hence, 



Px(^ aijXiXj = a) = Ex / exp [2^T^/^(^ aijXiXj - a)t)dt 



Pa;(y^%'^i2;j = a) < / |E-r exp(27r\/^(y^ aijXiXj)t)dt\ . 

i,j 
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Next we consider x as {xjj^Xjj), where xjj^Xjj are the vectors corresponding to i G C/ and 
i ^ U respectively. By the Cauchy-Schwarz inequahty 

= i[ E^c7E^y,a;^ exp (^27rV^( ^ aijXi{xj - x'j) + 

V ° ieu,jeu ieujeu 

< / Ea;j, exp (^27rv/^( ^ aijXi(xj - x'j) + ^ aij(xiXj - 

= j ^xu,x'^,xfj,x'^ exp (27rV^( XI ~ ~ Xj))t)dt. 



i&u,jeu 



where yu = xjj — x'jj and = Xfj — x'^, whose entries are iid copies of r/^/^. 



Thus we have 



/ \'E^exp{27rV^{y2o'ijXiXj)t)\dt\ < / E^^^^^^^ exp (27r\/^( V] ajjyi2;j)i)(ii 

° ieujeu ieujeu 

Because = ajj, we can write the last term as 

/ Ej/^,4,2/[„% exp (27rV^( X aijyiZj+ aji{-z'j)y[)t)dt 

= / E^,^ exp (27rAA-l( ^ aijViWj + ^ aijViWj)t)dt, 
° ieu,jeu ieu,jeu 

where t; := (yt/, -2;^) and u; := (y^, z^;). 
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To conclude the proof we observe that the entries of v and w are iid copies of and 



/ E^,^ exp ^27r\/^( ^ aijViWj + ^ aijViWj)t^dt = Py^^C^ Au{ij)viWj = 0). 



□ 



Next, it follows from Lemma 8.1 that 



Pv,u,C}ZAu{ij)v^Wj = 0) > n 



7.2 



This inequality means that p''q^^\Au) > We now apply Lemma 

Lemma 8.2. There exist a set Io(U) of size Oc^e(l) and a set I(U) of size at least n — n'' 
such that for any i £ I, there are integers ^ k(U) and kiig(U),iQ £ Iq{U), all hounded by 
„Oc,.(i)^ such that 



Note that Lemma 8.2 holds for all U. We will try to obtain a similar conclusion for A. 



As Io{U) C and k{U) < n, there are only n'^^-^^^) possibilities that {Io{U),k{U)) 

can take. Thus there exists a tuple (Iq, k) such that Iq{U) = Iq and k{U) = k for 2"/n'^c''^(^) 
different U. Let us denote this set of U by U. Thus 



\U\ > 2"/n^c:,.(i). 

Next, let / be the collection of i which belong to at least \U\/2 index sets Ijj- Then we have 



\I\\U\ + {n - \I\)\U\/2 > (n - n')\U\ 
1/1 > n - 2n\ 



Fix an i G /. Consider the tuples {kii^^{U),io G Iq) where i £ lu. Because there are only 
fiOc,eW possibilities such tuples can take, there must be a tuple, say {ku^^io G /q), such 
that {kuo{U),iQ G /q) = {ku^^iQ G /q) for at least |^/|/2n<^c,.{i) = 2"/n<^c'.«(i) sets U. 



Because |/o| = Oc,e(l), it is easy to see that there is a way to partition /q into /q U Iq such 
that there are sets U above satisfying that Iq C U and [/ n /q = 0- Let Z^/^,/^' 

denote the collection of these U . 
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By passing to consider a subset of Ui>^,r^^ if needed, we may assume that either i ^ U or 
i G U for all U G Uji^ jn. Without loss of generality, we assume the first case that i ^ U. 
(The other case can be treated similarly). 

Let U G u = (til, . . . , Un) be its characteristic vector, that is Uj = 1 if j G [/, and 

Uj = otherwise. Then, by the definition of Au, and because Ig C U and IqCiU = 0, for 
i'o G Iq and G Iq we can respectively write 



i=i i=i 
Also, because i , we have 



(ri(A[/),y) = ^aijUjyj. 
i=i 



Thus, 



eri(A[/),y)+ ^ (A;iiorio(^c/), 2/) 



«oe/o 



(/cri(^C/),y) + kii>^ri>^{Au),y) + { ^ /cii//ri//(^c;), y) 



j'lfzT" 



n n 



Next, by Lemma 8.2, for each U G lAji i" we have 



Vy{{kvi{Au),y) + Y {kiioriMu),y) = O) = n-^^-^^). 



Also, note that 



\Uj>j.\ = 2yn 



Hence, 
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ByEu{k{riiAu),y) + {h,,ri,{Au),y) = O) > n-OcA^\ 
ioS/o 

By applying the Cauchy-Schwarz inequality, we obtain 



2 

n 



-OcAi) < ByBu{k{ri{Au),y) + J] (A;ii,ri,(^c/), y) = 0) 



ioe/o 



2 



<Ey E[7(A;(ri(^{7),y) + {ku,ri^{Au),y) = 
\ ioe/o 



n 

= ^zi^ikaij + X kii,^a,>^j - kii'^ai.j)zj = O) 



where Zj := (uj — u'j)yj, and in the last inequality we used the simple observation that 
Eu,u'if{u) = 0,/K) = 0) < Buy if (u) - f{u') = 0). 

Note that Uj — u'- and yj are iid copies of r]^/^. Hence Zj are iid copies of r/^/^. 



Finally, by Theorem 3.5, the bound 



™ — ~ s 

1 = 1 v'P/"' i"pT" 



implies that there exists a proper symmetric GAP Qi of rank Oc'^e(l) and size n'^c,€W guch 
that the following holds for all but at most n' elements of j 



We summarize below. 

Theorem 8.3 (Refined row relation). Let e < 1 and C he positive constants. Assume that 
Pg(^) ^ n~'-' . Then there exist a set Iq of size Oc,e{^), ol set I of size at least n — 2n'' , a 
number 7^ A; = n^^A'^) such that for any i £ I there are integers ka^, i^ G Iq, all bounded 
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by n*^'^''=^^^, an index set Ji of size n — rf , and a proper symmetric GAP Qi of rank Oc,e{^) 
and size rpcA'^) such that the following holds for all j £ Ji 

kiioCLigj G Qi. 

Clearly, we may assume that I D Iq = by throwing away those i from / that also belong 
to Iq. 

Let R be the matrix defined below. 

Definition 8.4 (row matrix), is an n by n matrix, whose i-th row, where i £ I, is defined 

by 



(12) 







if j e ^o; 




k, 


if j = i; 




0' 


otherwise 



The other entries of R are zero except the diagonal terms which are set to be 1. 



We restate Theorem |8.3| in a more convenient way below. 

Theorem 8.5 (Refined row relation, again). Let e < 1 andC be positive constants. Assume 
that Pq{A) > . Then there exist a set Iq of size Oc,e{^), o, set I of size at least n — 2n'^ 
satisfying IDIq = 0, integers ^ k, kng, iq G Jq, i E /, all bounded by n^'^^^^^\ and a matrix 



R defined by (12) such that the matrix A' = RA possess the following properties: for each 
i G I, there exist a subset r'- C T^i{A') of size n — n*^ and a proper symmetric GAP Qi of 
rank Oc,e{^) ctnd size n'-^c.^W such that C Qi. 

Next, because A is symmetric, we obtain a similar relation between the columns of A. 
Hence, we obtain the following key result. 

Theorem 8.6 (Matrix relations). Let e < 1 and C be positive constants. Assume that 
Pq{^) ^ n^^ . Then there exist a set Iq of size Oc,e{^), o- set L of size at least n — 2n'^ 
satisfying L D Iq = $, integers ^ k,kiig,io G LQ,i €z L , all bounded byn^'^'^^^^ and a matrix 
R defined by (12) such that the matrix A' = RAR^ possess the following properties. 



For each i £ I, there exist a subset r^ C ri(^') of size n — n'' and a proper symmetric 
GAP Qi of rank Oc,e{^) md size rfcA^) such that r[<Z Qi. 

For each j € /, there exist a subset c'j C Cj(A') of size n — rf and a proper symmetric 
GAP Pj of rank Oc,e(l) and size n'^^j.^Ci) such that c'- C Pj. 



We complete the proof of Theorem 5.6 by using (11), and Theorem 5.7 by using Lemma 
7.9, noting that kij = kji and ajj„ = aj^j. 



Remark 8.7. In later application we will not need the whole strength of Theorem 8.6 It 



will suffice to apply Theorem 8.5 
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9. PROOF OF Lemma 12.61 

We now prove Lemma |2.6| by using our inverse Littlewood-OfFord result for linear forms 
presented in Section [3| 

First of all, because rank(M„_i) = n — 2, the cofactor matrix (aij) of M^-i has rank 1. 
Because this matrix is symmetric, each entry aij must have the form ajOj, where not all the 
a,- are zeros. 



We will show that the vector u = (oi, . . . , a„_i) satisfies the conclusions of Lemma 2.6 
Observe that 

n-l 

det(M„) = ^ aijXiXj = (^aiXi)"^. 

l<i,j<n— 1 i=l 

Thus the assumption P(det(M„) = 0|M„_i) > n^*^ implies that 



n— 1 



By Theorem 3.4, all but n"^ elements of ai belong to a proper symmetric GAP of rank 
Oc',e(l) and size n'^'^-^^^\ Also, by the definition of the Oj, u = (ai, . . . ,a„_i) is orthogonal 
to n — 2 linearly independent rows of M„_i. We finish the proof of Lemma [2. 6| by using the 
following lemma. 

Lemma 9.1 (Rational commensurability) . Let v = (fi, . . . ,Vn-i) be a vector such that all 
but rf components Vi belong to a proper symmetric GAP of rank Oc,e{^) and size vP'^'^^^\ 
and that v is a normal vector of a hyperplane spanned by vectors of integral components 
bounded by n^^'^^^\ Then {ui, . . . ,Un-i} C {{p/q)viQ, \p\, \q\ = rP^'^^'^^'>} for some iq. 



Proof, (of Lemma 9.1 ) Without loss of generality, we assume that {vn-n^, • • ■ , Vn-i) are the 



exceptional elements that may not belong to the GAP. 

For each Vi, where i < n — n'', there exist numbers Uy, all bounded by rfi'^'''^^\ such that 

Vi = Viigi + . ..Virgr, 

where gi, . . . ,gr are the generators of the GAP. 



Note that by Theorem 6.1 , one may assume that the vectors {vn, . . . , Vir), where i < n — n^. 



generate the whole space R*". 

Consider the n — 1 by r + n"^ matrix whose i-th. row is the vector {vn, . . . ,Vir,0, . . . ,0) 
if i < n — rf, and (0, . . . , 0, 1, 0, . . . , 0) if n — < i. Note that has rank r + n"^. 
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We thus have 



where u = {gi, . . . , gr , Vn-n'^ , ■ ■ ■,Vn-i)- 

Next, let wi, . . . ,Wn-2 be the vectors of integral entries bounded by n'^c.cW which are 
orthogonal to v. We form an n — 1 by n — 1 matrix whose i-th row is Wi for i < n — 2, 
and the n — 1-th row is ej^, a unit vector among the standard basis {ei, . . . , e^-i} that is 
linearly independent to tt;i, . . . .Wn-2- 

By definition, we have MyjV^ = (0, . . . , 0, Vi^)'^ , and hence 



{Mu,M,,)u^ = {0,...,0,vi,f. 
The identity above implies that 



{M^M,){—uf = {0,...,0,lf. (13) 
Next we choose a submatrix M of size r + n*^ by r + n*^ of M^M^ thas has full rank. Then 



M(—u)'^ = x (14) 



for some x which is a subvector of (0, . . . , 0, 1) from (13). 



Observe that the entries of M are integers bounded by rP^-^^^\ Hence, the entries of M ^ 
are fractions whose numerators and denominators are integers bounded by {rpcA'^)y+^^ = 



Solving for gi/vi^ and Vj/vi^ from (14), we conclude that each of these components can be 



written in the form p/q, where \p\, \q\ = iiPcA^"), 

□ 



Remark 9.2. In principle. Lemma 9.1 is similar to Theorem 5.2 of [24.j • 



10. Proof of Lemma [2771 



In this section we will apply the results from Section [5] and Section |8] to prove Lemma 
First, assume that 



2.7 
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^xC^CLijXiXj = 0|M„_i) > n" 



c 



Let A be the matrix {atj). Then by Theorem 5.6 (or more exphcitly, Theorem 8.5), there 
exists a non-singular matrix R (see Definition 8.4) such that most of the entries of each row 
of A' belong to proper symmetric GAPs of small ranks and small sizes, where A' = RA. 



Set 



M := Mn-iR~^. 



Because M^-iA = det(M„_i) • / 0, we have 



MA' = Mn-iA = det(M„_i) • / O. 



(15) 



Next, it follows from the definition of R that 



R-Hij) 



' 1/k if i € / and j = i; 

—kij/k if i G / and j G /q; 

1 if i ^ / and j = i; 

if i ^ / and j ^ i. 



We thus have, by M{ij) = Mn-i{ij')iR'^)U' j), that 



M{ijo) = Yl Mn-i{ij'){-kfjjk) + Mn-iiijo), if Jo G h; 
j'ei 

M{ij) = Mn-i{ij)/K ^ijei; 



M{ij) = Mn-i{ij), ifi ^/oU/. 



(16) 



Because the entries of M„_i are ±1, and k 



n 



'^c.iW ii^Q entries of M are rational 



numbers of the form m/k, where m G Z and m = n^'^'''^^\ Furthermore, note that M also 
has full rank. 

Let V be any column of A' whose all but n*^ components belong to a proper symmetric GAP 
of rank Oc,e{^) and size n'^^'^^^\ 

Because MA' = det(Af„_i) • 7^ 0, v is not a zero vector which is orthogonal to n — 2 rows 
of M. Hence, it follows from Lemma 9.1 that {vi, . . . ,Vn-i} C {{p/q)vif), \p\, \q\ = n'^c''^^"'^-*} 
for some io- 
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Next, consider a row rj(M) that is orthogonal to where i €z I. Note that there are at 
least 1/1 — 1 > n — 2n'' — 1 such indices i. We have 



Y,M{ij)v, = ^ M{ijo)vj, + ^Miij)vj+ Yl Miij)v, 

- XI '^^n-l{ij')kj'joVjo/k+ X Mn^l{ijo)vjg +'YMn-i{ij)vj/k + ^ Mn-l{ij)Vj 

j'el joe/o joe-fo ie^ joih^l 

YMn-i{ij){vj/k - X kjjgVjJk)+ ^ M„„i(ijo)t;-,o + ^ Mn-i{ij)vj 
i&i ioG/o io6-fo iih^i 

0. (17) 



Define 



tio := < 



It then follows from (17) that 



Thus, the vector u = {ui, . . . ,Un-i) is orthogonal to ri(M„_i). This holds for at least 
n — 2rf — 1 rows of M„_i. 

Additionally, by the definition of u and all but n'' coordinates of u belong to a proper 
symmetric GAP of rank Oc,e{^) and size rpcA'^) (with probably worse parameters), and 
{ui, . . . ,n„_i} C {{p/q)uj^, \p\, \q\ = nOcA"^")] for some jo- 

We conclude the proof by noting that, because v is not a zero vector, u is not either. 



11. PROOF OF Theorem 12.41 and Theorem 12.51 



Assume that M„_i has rank n — 2 or n — 1, and P(det(M„) = 0|M„_i) > n'^ . We apply 



Lemma 2.6 and 2.7 to obtain a vector u = (ui, . . . , Un-i) of the following properties. 



(1) All but rf elements of Ui belong to a proper symmetric GAP of rank Oc^e(l) and 
size n'^c,.(i). 

(2) Ui G {p/q : \p\M\ = n'^c.^K)} for ah i. 
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(3) u is orthogonal to n — Oc^e(n'^) rows of M^-i- 



Let V denote the collection of all u having property (1) and (2). For each u £ V, let be 
the probability, with respect to M„_i, that u is orthogonal to n — Oc,e{n^) rows of Mn-i. 
We shall prove the following key result. 

Theorem 11.1. We have 

^P„ = 0c,e((l/2)(^-°«)"). 



It is clear that Theorem 12.41 and Theorem 12.51 follow from Theorem lll.il 

In the sequel we will choose < (5 to be small enough so that 6 ■ Oc,t{^) ^ e/4 for all 



constants Oce(l) appearing in Lemma 2.6 and Lemma 



2.7 



Let Uu denote the number on nonzero components of u. To prove Theorem 11.1 we decom- 
pose the sum ^„g-p into two parts depending on the magnitude of n^. 

Theorem 11.2. The probability of a random symmetric matrix Mn-i having n — Oc,e{n'') 
rows being orthogonal to a vector u G V having Uu < n^~^ is bounded by 



J2 Pu = ((l/2)(i-(i))") , 

uG'P,nu<n^-^ 

where the implied constants depend on C, e and 5. 

Theorem 11.3. The probability of a random symmetric matrix -/Vf„_i having n — Oc,e{rf) 
rows being orthogonal to a vector u G V having n„ > n^^^ is bounded by 



J2 Fu = 0(n-^-V32), 



where the implied constants depend on C, e and 5. 



Proof, (of Theorem 11.2) By paying a factor {^Qc (n^)) ~ 0{n^'^'^^'^^^) in probability, we 
may assume that the first n — Oc,t{n'') rows of M„_i are orthogonal to u. 

Also, by paying a factor ) in probability, we may assume that the first Uu components 
of u are nonzero. Thus we have 



2u,ri(M„_i) = 0. 



i=l 



Which in turn implies that r„^(M„_i) lies in the subspace spanned by ri(M„_i), . . . , r„^_i(M„_i). 



INVERSE LITTLEWOOD-OFFORD PROBLEMS 



35 



Next, due to symmetry, rn„(M„_i) has — 1 components that were already exposed in 
the first n„ — 1 rows (if we work with the general case that the rows in consideration are 
not necessarily the first n„ rows of M„_i, then there are less dependencies: at most riu — 1 
components already exposed in the previous n„ — 1 rows.) 

Let r'„^ be the subvector obtained from by removing the exposed components, and for 
each 1 < z < n^j — 1 we let be the subvectors of rj(M„_i) corresponding to the columns 
restricted by r'„^ . 

By definition, each r'- has n — n„ components, and because r„^(M„_i) lies in the sub- 
space spanned by ri(M„_i), . . . , r„^_i(M„_i), so does ri^ in the subspace spanned by 



r^, . . . , r^^_^. The probability for this event, by Lemma 2.2 is at most 
Thus we have 

where the implied constants depend on C, e and 5. 



□ 



Remark 11 A. In the proof of Theorem 11.2, because the assumption that u has many zero 
components is strong, we do not need the additional additive structure on the remaining 
components of u. 

We next focus on the estimate for the minor term. 



Proof, (of Theorem 11.3) By paying a factor of ) probability and without loss 



of generality, we may assume that u has the following properties: 

• the first riu components of u are nonzero; 

• the first := n^ — n'' components of u are non-exceptional (that is they all belong 
to a proper symmetric GAP of rank Oc,t{l) and size rfi^'^^^\) 

Because u is orthogonal to n — Oc,e{n'^) rows of M„_i, it is orthogonal to ni := riQ — Ocein'^) 
rows among the first no rows of M„_i. By paying a factor of {o(^\n^)) ~ 0{nu^'^^^ ^) in 
probability, we may assume that these are the first ni rows of Mn-i- (One proceed similarly 
in the general case, occasionally with better bounds due to more independence among the 
entries.) 
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We will expose the first rii rows of Mn-i one by one. Let i be an index between 1 and ni. 
Condition on the first i — 1 rows of Mn-i, the probability that rj(M„_i) is orthogonal to u 
is controlled by 

^X„...,Xnu^{-l,l}C^ ^j'^j 
j=i 

no 

< pi{u) := supP^^^.., = a). 

Observe that pi{u) < ••• < p„^(n). With room to spare, we concentrate on pi{u) where 
i < {1 — S)nQ only. 

Note that (1 — (5)no < ni, thus the probability that the first ni rows of M„_i are orthogonal 
to u is bounded by 



i-l 

= -"^XjUj) < 



(l-5)no 

P (rj(M„_i), 1 < i < (1 — S)no, are orthogonal to u) < pi. (18) 

1=1 

Note that the nonzero Uj,j = 1, . . . ,no, all belong to a proper symmetric GAP of rank 
Oc^e(l) and size n'^^'^^^\ It thus follows from the Erdos-Littlewood-Offord inequality ([2]) 
and Example 3.3) that for any 1 < i < (1 — S)nQ 



n 



-OcAD < p^^u) = 0((5no)-i/2) = 0((5n„)-i/2). (19) 



Next we fix a sequence bQ,bi, . . . , bx, where the left bound of (Il9h and 

:= n^bi, as well as K is the smallest index such that bx exceeds the right bound of 

(To]) (thus K < Oc,.(i)ri). 

By the definition of the sequence 6j, for any 1 < f < (1 — 5)no we have 



^'0 < Pi{u) < bK- 

In the next step, we classify u depending on how fast the concentration probabilities Pi{u) 
grow. 

Definition 11.5 (concentration sequence). We say that a. u G V satisfying > n^~^ has 
concentration sequence {mi, . . . , itik), where mi + • • ■ + mK = (1 — S)nQ, if there are exactly 
rrij terms pi{u) belonging to [bj-i,bj). 

Observe that the smaller 5 we choose, the more detail we know about the distribution of 
Pi{u). 
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Basing on concentration sequences, we say that u G V belongs to 'P(mi,...,mx) concen- 
tration sequence is (mi, . . . , niK)- 

Our next lemma is to show that there is a collection of structures that contains all the 
elements of 'P{mi,...,mx)- This result will then enable us to compute in a convenient way. 

Theorem 11.6. Assume that u € 'P(mi,...,mK) • Then there exists a sequence of proper 
symmetric GAPs Qq, Qi, . . . , Qk such that 

(1) Ui G Qq for all 1 < i < uq; 

(2) Uj G Qi for all but /K indices j with mi + • • • + < j < mi + • • • + mj/ 

(3) \Qi\ < chT^n^ /{n^yl'^, where c is a constant depending only on C, e and 6; 

(4) all the generators of Qi belong to the set {p/q, \p\, \q\ < n'^'^''^'^^"""^} . 



Theorem 11.6 can be shown by applying Theorem 3.4 several times. To begin with, we set 
Qo to be the proper symmetric GAP that contains all the non-exceptional u. 

Next, as 



Prrti- 



Theorem 3.4 implies that all but at most n'^/K components Uj, where mi + • • • + 7nj_i < 
J < (1 — 6)nQ, belong to a proper symmetric GAP Qi of size 



= Oc,.,siK'n'/in^)'/'). 



We keep this information only for those Uj where mi + • • • + < j < mi + • • • + mj, and 



release other uj for the next application of Theorem 3.4, By Theorem 6.1 



we may assume 



that these Uj span Qi, and thus (4) holds because uj G {p/q, \p\, \q\ 



n 



}• 



Now for each u G V, 



(mi,...,mx) 



, we reconsider the probability that the first ni rows of M„_i 



are orthogonal to u. As shown in (18), this probability is bounded by HiPj- definition 
of concentration sequence, we have 



(l-(5)no K 

n p^^Ub^ 



(20) 



i=l 



In the next sequel we want to sum this bound over u G 'P(mi,...,mx)- 
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Because each Qi is determined by its Oc,e,5(l) generators from the set {p/*?, I*?! < 
t^Oce.^C"")}^ and its dimensions from the integers bounded by rpc,i,sW ^ there are rf'c,t,6{n'') 
ways to choose each Qi . So the total number of ways to choose Qo , • • • , Qk is 



(21) 



Next, after locating Qi, the total number of ways to choose is 



K 



K 



K 



i=i \^y^J i=i 



i=l 



where (J T/'J ig ^l""'-"'/^ is the number of ways to choose Uj from each Qi, following (2) of 
Theorem 111.61 



We then continue to estimate 



K 



K 



i=l 



i=l 
K 

= (2c)'^^~'^^"'" JJ 57'"'n^(l-'^)'^Oj^-':(l-<5)"-o/2 



K 



i=l 



(22) 



i=l 



where in the last estimate we use the fact that 6 < e/16. 

For the remaining non-exceptional Ui, where (1 — 6)nQ < i < uq or Uj ^ Qi from (2) of 



Theorem 11.6, we choose them from Qq, which results in the bound 



(23) 



where we use the fact that 6 is chosen so that 6 ■ Oc,e{^) ^ e/16, and n*^ = o{n ) = o(no). 

Regarding the exceptional elements Ui, where riQ < i < riu, we may choose them from 
{p/9)|p|>kl < n*^*^''*-"^^}, which results in the bound 



(24) 



Putting the estimates (21), (22), (23) and (24) together we obtain the bound for total 



number of ways to choose u 
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K K 



„Oc,.,.(n2^)^-mo/8-rr^-m, < 0(j^-^«o/16) TT ^-m^ ^ 



i=l 1=1 

where we use the fact that v?'' = o{n}'~^) = o(no). 



Thus, according to (20) we have 



P (rj(M„_i), 1 < i < (1 — (5)no, are orthogonal to u) = 0( 



'^^^(mi,...,m^) 



Summing over the number of concentration sequences {mi, . . . , m^) (which can be bounded 
cheaply by = n'^c,eWS over the positions of nonzero components and ng non- 
exceptional components of u (which is bounded by 0{(^"'~ ) (""))), and over the position of 

ni rows of M„_i that are orthogonal to u (which is bounded by 0{n^^'^^^ ^)), we hence 
obtain 



where the implied constant depends on C, e and 5, completing the proof. 

□ 
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